Decoupling, Sparsity, Randomization, and Objective Bayesian Inference
نویسنده
چکیده
Decoupling is a general principle that allows us to separate simple components in a complex system. In statistics, decoupling is often expressed as independence, no association, or zero covariance relations. These relations are sharp statistical hypotheses, that can be tested using the FBST Full Bayesian Significance Test. Decoupling relations can also be introduced by some techniques of Design of Statistical Experiments, DSEs, like randomization. This article discusses the concepts of decoupling, randomization and sparsely connected statistical models in the epistemological framework of cognitive constructivism.
منابع مشابه
Exploiting sparsity and sharing in probabilistic sensor data models
Probabilistic sensor models defined as dynamic Bayesian networks can possess an inherent sparsity that is not reflected in the structure of the network. Classical inference algorithms like variable elimination and junction tree propagation cannot exploit this sparsity. Also, they do not exploit the opportunities for sharing calculations among different time slices of the model. We show that, us...
متن کاملBayesian Statistical Pragmatism. Discussion of Statistical Inference: The Big Picture by R. E. Kass
Kass describes probability theory as anchored upon physical randomization (coin flips, die rolls and the like) but being useful more generally as a mathematical model. I completely agree but would also add another anchoring point: calibration. Calibration of probability assessments is an objective, not subjective process, although some subjectivity (or scientific judgment) is necessarily involv...
متن کاملDecoupling Sparsity and Smoothness in the Discrete Hierarchical Dirichlet Process
We present a nonparametric hierarchical Bayesian model of document collections that decouples sparsity and smoothness in the component distributions (i.e., the “topics”). In the sparse topic model (sparseTM), each topic is represented by a bank of selector variables that determine which terms appear in the topic. Thus each topic is associated with a subset of the vocabulary, and topic smoothnes...
متن کاملImplementation of Traditional (S-R)-Based PM Method with Bayesian Inference
In order to perform Preventive Maintenance (PM), two approaches have evolved in the literature. The traditional approach is based on the use of statistical and reliability analysis of equipment failure. Under statistical-reliability (S-R)-based PM, the objective of achieving the minimum total cost is pursued by establishing fixed PM intervals, which are statistically optimal, at which to replac...
متن کاملBayesian Sparsity for Intractable Distributions
Bayesian approaches for single-variable and group-structured sparsity outperform L1 regularization, but are challenging to apply to large, potentially intractable models. Here we show how noncentered parameterizations, a common trick for improving the efficiency of exact inference in hierarchical models, can similarly improve the accuracy of variational approximations. We develop this with two ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
- Cybernetics and Human Knowing
دوره 15 شماره
صفحات -
تاریخ انتشار 2008